Decision-makers' experiences with rapid evidence summaries to support real-time evidence informed decision-making in crises: a mixed methods study.

BACKGROUND: There is a clear need for research evidence to drive policymaking and emergency responses so that lives are saved and resources are not wasted. The need for evidence support for health and humanitarian crisis is even more pertinent because of the time and practical constraints that decision-makers in these settings face. To improve the use of research evidence in policy and practice, it is important to provide evidence resources tailored to the target audience. This study aims to gain real-world insights from decision-makers about how they use evidence summaries to inform real-time decision-making in crisis-settings, and to use our findings to improve the format of evidence summaries. METHODS: This study used an explanatory sequential mixed method study design. First, we used a survey to identify the views and experiences of those who were directly involved in crisis response in different contexts, and who may or may not have used evidence summaries. Second, we used the insights generated from the survey to help inform qualitative interviews with decision-makers in crisis-settings to derive an in-depth understanding of how they use evidence summaries and their desired format for evidence summaries. RESULTS: We interviewed 26 decision-makers working in health and humanitarian emergencies. The study identified challenges decision-makers face when trying to find and use research evidence in crises, including insufficient time and increased burden of responsibilities during crises, limited access to reliable internet connection, large volume of data not translated into user friendly summaries, and little information available on preparedness and response measures. Decision-makers preferred the following components in evidence summaries: title, target audience, presentation of key findings in an actionable checklist or infographic format, implementation considerations, assessment of the quality of evidence presented, citation and hyperlink to the full review, funding sources, language of full review, and other sources of information on the topic. Our study developed an evidence summary template with accompanying training material to inform real-time decision-making in crisis-settings. CONCLUSIONS: Our study provided a deeper understanding of the preferences of decision-makers working in health and humanitarian emergencies about the format of evidence summaries to enable real-time evidence informed decision-making.

Public health and social measures during health emergencies such as the COVID-19 pandemic: An initial framework to conceptualize and classify measures.

Background: Public health and social measures (PHSM) intend to reduce the transmission of infectious diseases and to reduce the burden on health systems, economies and societies. During the COVID-19 pandemic, PHSM have been selected, combined and implemented in a variable manner and inconsistently categorized in policy trackers. This paper presents an initial conceptual framework depicting how PHSM operate in a complex system, enabling a wide-reaching description of these measures and their intended and unintended outcomes. Methods: In a multi-stage development process, we combined (i) a complexity perspective and systems thinking; (ii) literature on existing COVID-19 PHSM frameworks, taxonomies and policy trackers; (iii) expert input and (iv) application to school and international travel measures. Results: The initial framework reflects our current understanding of how PHSM are intended to achieve transmission-related outcomes in a complex system, offering visualizations, definitions and worked examples. First, PHSM operate through two basic mechanisms, that is, reducing contacts and/or making contacts safer. Second, PHSM are defined not only by the measures themselves but by their stringency and application to specific populations and settings. Third, PHSM are critically influenced by contextual factors. The framework provides a tool for structured thinking and further development, rather than a ready-to-use tool for practice. Conclusions: This conceptual framework seeks to facilitate coordinated, interdisciplinary research on PHSM effectiveness, impact and implementation; enable consistent, coherent PHSM monitoring and evaluation; and contribute to evidence-informed decision-making on PHSM implementation, adaptation and de-implementation. We expect this framework to be modified and refined over time.

Development of a knowledge broker group to support evidence-informed policy: lessons learned from Myanmar.

BACKGROUND: Globally, policy-makers face challenges to using evidence in health decision-making, particularly lack of interaction between research and policy. Knowledge-brokering mechanisms can fill research-policy gaps and facilitate evidence-informed policy-making. In Myanmar, the need to promote evidence-informed policy is significant, and thus a mechanism was set up for this purpose. This paper discusses lessons learned from the development of the Knowledge Broker Group-Myanmar (KBG-M), supported by the Johns Hopkins Bloomberg School of Public Health's Applied Mental Health Research Group (JHU) and Community Partners International (CPI). METHODS: Sixteen stakeholders were interviewed to explore challenges in formulating evidence-informed policy. Two workshops were held: the first to further understand the needs of policy-makers and discuss knowledge-brokering approaches, and the second to co-create the KBG-M structure and process. The KBG-M was then envisioned as an independent body, with former officials of the Ministry of Health and Sports (MoHS) and representatives from the nongovernmental sector actively engaging in the health sector, with an official collaboration with the MoHS. RESULTS: A development task force that served as an advisory committee was established. Then, steps were taken to establish the KBG-M and obtain official recognition from the MoHS. Finally, when the technical agreement with the MoHS was nearly complete, the process stopped because of the military coup on 1 February 2021, and is now on hold indefinitely. CONCLUSIONS: Learning from this process may be helpful for future or current knowledge-brokering efforts, particularly in fragile, conflict-affected settings. Experienced and committed advisory committee members enhanced stakeholder relationships. Responsive coordination mechanisms allowed for adjustments to a changing bureaucratic landscape. Coordination with similar initiatives avoided overlap and identified areas needing technical support. Recommendations to continue the work of the KBG-M itself or similar platforms include the following: increase resilience to contextual changes by ensuring diverse partnerships, maintain advisory committee members experienced and influential in the policy-making process, ensure strong organizational and funding support for effective functioning and sustainability, have budget and timeline flexibility to allow sufficient time and resources for establishment, organize ongoing needs assessments to identify areas needing technical support and to develop responsive corrective approaches, and conduct information sharing and collaboration between stakeholders to ensure alignment.

Methods to support evidence-informed decision-making in the midst of COVID-19: creation and evolution of a rapid review service from the National Collaborating Centre for Methods and Tools.

BACKGROUND: The COVID-19 public health crisis has produced an immense and quickly evolving body of evidence. This research speed and volume, along with variability in quality, could overwhelm public health decision-makers striving to make timely decisions based on the best available evidence. In response to this challenge, the National Collaborating Centre for Methods and Tools developed a Rapid Evidence Service, building on internationally accepted rapid review methodologies, to address priority COVID-19 public health questions. RESULTS: Each week, the Rapid Evidence Service team receives requests from public health decision-makers, prioritizes questions received, and frames the prioritized topics into searchable questions. We develop and conduct a comprehensive search strategy and critically appraise all relevant evidence using validated tools. We synthesize the findings into a final report that includes key messages, with a rating of the certainty of the evidence using GRADE, as well as an overview of evidence and remaining knowledge gaps. Rapid reviews are typically completed and disseminated within two weeks. From May 2020 to July 21, 2021, we have answered more than 31 distinct questions and completed 32 updates as new evidence emerged. Reviews receive an average of 213 downloads per week, with some reaching over 7700. To date reviews have been accessed and cited around the world, and a more fulsome evaluation of impact on decision-making is planned. CONCLUSIONS: The development, evolution, and lessons learned from our process, presented here, provides a real-world example of how review-level evidence can be made available - rapidly and rigorously, and in response to decision-makers' needs - during an unprecedented public health crisis.

Assessing the Electronic Evidence System Needs of Canadian Public Health Professionals: Cross-sectional Study.

BACKGROUND: True evidence-informed decision-making in public health relies on incorporating evidence from a number of sources in addition to traditional scientific evidence. Lack of access to these types of data as well as ease of use and interpretability of scientific evidence contribute to limited uptake of evidence-informed decision-making in practice. An electronic evidence system that includes multiple sources of evidence and potentially novel computational processing approaches or artificial intelligence holds promise as a solution to overcoming barriers to evidence-informed decision-making in public health. OBJECTIVE: This study aims to understand the needs and preferences for an electronic evidence system among public health professionals in Canada. METHODS: An invitation to participate in an anonymous web-based survey was distributed via listservs of 2 Canadian public health organizations in February 2019. Eligible participants were English- or French-speaking individuals currently working in public health. The survey contained both multiple-choice and open-ended questions about the needs and preferences relevant to an electronic evidence system. Quantitative responses were analyzed to explore differences by public health role. Inductive and deductive analysis methods were used to code and interpret the qualitative data. Ethics review was not required by the host institution. RESULTS: Respondents (N=371) were heterogeneous, spanning organizations, positions, and areas of practice within public health. Nearly all (364/371, 98.1%) respondents indicated that an electronic evidence system would support their work. Respondents had high preferences for local contextual data, research and intervention evidence, and information about human and financial resources. Qualitative analyses identified several concerns, needs, and suggestions for the development of such a system. Concerns ranged from the personal use of such a system to the ability of their organization to use such a system. Recognized needs spanned the different sources of evidence, including local context, research and intervention evidence, and resources and tools. Additional suggestions were identified to improve system usability. CONCLUSIONS: Canadian public health professionals have positive perceptions toward an electronic evidence system that would bring together evidence from the local context, scientific research, and resources. Elements were also identified to increase the usability of an electronic evidence system.